What is claimed is 

1. A face recognition apparatus which recognizes a face by using an 
artificial neural network, comprising: 

an eigenpaxel selection unit which generates eigenpaxels representing 
5 characteristic patterns of a face and selects a predetermined number of 
eigenpaxels among the generated eigenpaxels; 

an eigenfiltering unit which filters an input facial image with the selected 
eigenpaxels; 

a predetermined number of neural networks, each of which corresponds 
10 to one of the selected eigenpaxels, receives an image signal which is filtered by 
the corresponding eigenpaxel, and output a face recognition result; and 

a determination unit which receives the recognition result from each of 
the neural networks and outputs a final face recognition result of the input 
image. 

15 

2. The apparatus of claim 1, wherein the eigenpaxel selection unit 
comprises: 

an eigenpaxel generation unit which divides an arbitrary face image into 
predetermined blocks, and by applying a principal component analysis to each 
20 of the blocks, generates eigenpaxels indicating predetermined pattern 
characteristics of the face. 

3. The apparatus of claim 2, wherein the eigenpaxel selection unit further 
comprises: 

25 an eigenpaxel selection unit which selects a predetermined number of 

vectors among the selected eigenpaxels in order of decreasing eigenvalues of 
the vectors. 

4. The apparatus of claim 1, wherein the eigenfiltering unit eigenfilters the 
30 input image by performing convolution operation while moving each eigenpaxel 

for the input image. 
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5. The apparatus of claim 4, wherein the eigenfiltering unit divides the 
input image into predetermined blocks, and performs convolution operations 
moving the divided blocks over the eigenpaxels such that the blocks and 
eigenpaxels overlap to a predetermined part, and outputs an eigenfiltered 

5 image which is reduced to a predetermined size. 

6. The apparatus of claim 1 , wherein the neural network is trained by a 
back propagation algorithm having added momentum, and at this time 
weighting coefficient (w,) is updated by the following equation: 

10 

AW y (t + 1) = + aAW y (t) 

where t] denotes a learning coefficient, j denotes the index of a current 

unit, i denotes the index of a unit preceding the unit j, 5 } denotes the output 

error of unit j, Oj denotes the output of unit i, and a denotes a constant 
15 determining the affect of momentum. 

7. The apparatus of claim 1, wherein the number of neurons in the output 
layer of the neural network is the same as the number of learned faces. 

20 8. The apparatus of claim 1 , wherein the determination unit comprises: 

a reliability value calculation unit which converts the received output 
value of the output layer neurons of each neural network into a value in a 
predetermined range, calculates reliability values, and adds reliability values for 
the output layer neurons of each neural network; 
25 a face selection unit which selects a face detected by a predetermined 

number of high level neural networks according to the reliability value; 

a grade calculation unit which gives a grade to the reliability value of 
each neural network, and for the selected face, calculates a first grade order of 
the entire neural network and a second grade order of a predetermined number 
30 of high level neural networks; 

a grouping unit which classifies the selected faces into predetermined 
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face groups, by comparing the first grade order and second grade order with a 
predetermined first threshold grade order and a predetermined second 
threshold grade order, respectively; and 

a recognition result output unit which outputs a face belonging to a first 
5 face group having a first grade and a second grade bigger than the first 
threshold grade order and the second threshold grade order, respectively, as 
the recognition result. 

9. The apparatus of claim 8, wherein the reliability value calculation unit 
io converts each output value of the output layer neurons of each neural network, 

into a ratio of each output value of the neural network to the sum of the output 
values of a neural network. 

10. The apparatus of claim 9, wherein the reliability value calculation unit 
is converts each output value of the output layer neurons of each neural network 

according to the following equation: 

exp(10wj 
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p 

where w a denotes the actual output value of each neuron of a neural 
20 network and p denotes the total number of output layer neurons. 

11. The apparatus of claim 9, wherein the reliability value calculation unit 
calculates the reliability value of a neural network according to the following 
equation by using the converted output value: 

25 

where y m ax,i denotes the largest converted output value and y ma x,2 
denotes the second largest converted output value. 

30 12. The apparatus of claim 11, wherein the reliability value of the neural 
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network is set as the reliability value of an output layer neuron having the 
largest converted output value, and the reliability values of the remaining output 
layer neurons are set to 0. 



5 13. The apparatus of claim 10, wherein the grade calculation unit gives a 
grade to the reliability value of each neural network, and calculates a first grade 
order, in which the grades of entire neural network for the selected faces are 
arranged in order from a high level neural network to a low level neural network, 
and a second grade order, in which the grades of the predetermined number of 

10 neural networks for the selected faces are arranged in order from a high level 
neural network to a low level neural network. 

14. The apparatus of claim 10, wherein among a plurality of faces 
belonging to a first face group, the recognition result output unit outputs a face 

15 which is input by the reliability value calculation unit and has a bigger sum of 
reliability values, as the recognition result. 

15. A face recognition apparatus which recognizes a face by using an 
artificial neural network, comprising: 

20 an eigenpaxel selection unit which generates eigenpaxels representing 

characteristic patterns of a face and selects a predetermined number of 

eigenpaxels among the generated eigenpaxels; 

an input image normalization unit which receives a face image and 

outputs a face image normalized in a predetermined format; 
25 an eigenfiltering unit which filters the normalized input image with the 

respective selected eigenpaxels; 

a sub-sampling unit which sub-samples the images filtered by 

respective eigenpaxels and outputs images of a size appropriate for neural 

network input; 

30 a predetermined number of neural networks, each of which corresponds 

to one of the selected eigenpaxels, receives an image signal which is filtered 
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with a corresponding eigenpaxel and sub-sampled, and outputs a face 
recognition result; and 

a determination unit which receives the recognition result from each of the 
neural networks and outputs a final face recognition result of the input image. 

5 

16. A face recognition method for recognizing a face by using an artificial 
neural network, comprising: 

(a) generating eigenpaxels representing characteristic patterns of a face 
and selecting a predetermined number of eigenpaxels among the generated 

10 eigenpaxels; 

(b) training the neural network using the selected eigenpaxels; 

(d) obtaining an eigenfiltered image containing patterns of face 
characteristics corresponding to the eigenfilters by eigenfiltering an input image 
with the respective selected eigenpaxels; 
15 (e) performing face recognition on each pattern of face characteristics 

by outputting the eigenfiltered image to a neural network corresponding to each 
of the selected eigenpaxels; and 

(f) analyzing the face recognition result of each neural network and 
outputting a final face recognition result of the input image. 

20 

17. The method of claim 16, wherein the step (a) further comprises: 
dividing an arbitrary face image into predetermined blocks, and by 

applying a principal component analysis to each of the blocks, generating 
eigenpaxels indicating regular pattern characteristics of the face. 

25 

18. The method of claim 17, wherein the step (a) further comprises: 
selecting a predetermined number of vectors among the generated 

eigenpaxels in order of decreasing eigenvalues of the vectors. 

30 19. The method of claim 16, wherein in the step (b), the neural network is 
trained by a back propagation algorithm having added momentum, and at this 
time weighting coefficient (w,) is updated by the following equation: 
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AW 0 (t + 1) = r/SjO, + aAW..(t) 

where tj denotes a learning coefficient, j denotes the index of a current 

unit, i denotes the index of a unit preceding the unit j, S } denotes the output 

5 error of unit j, Oj denotes the output of unit i, and a denotes a constant 
determining the affect of momentum. 

20. The method of claim 16, wherein the number of neurons in the output 
layer of the neural network is the same as the number of learned faces. 

10 

21. The method of claim 16, wherein in the step (d) the input image is 
eigenfiltered by performing convolution operation with moving each eigenpaxel 
for the input image. 

15 '22. The method of claim 21, wherein in the step (d) the input image is 
divided into predetermined blocks, and convolution operations are performed by 
moving the divided blocks over the eigenpaxels such that the blocks and 
eigenpaxels overlap to a predetermined part, and then an eigenfiltered image 
which is reduced to a predetermined size is obtained. 

20 

23. The method of claim 16, wherein the step (b) comprises: 

(b1) normalizing the input learning image into a predetermined form; 
(b2) eigenfiltering the normalized learning image with the eigenpaxels 

selected in the step (a) and obtaining an eigenfiltered image containing patterns 
25 of face characteristics corresponding to the eigenfilters; and 

(b3) by sub-sampling each of the eigenfiltered images and inputting a 

neural network corresponding to each of the selected eigenpaxels, training each 

of the neural networks. 

30 24. The method of claim 16, wherein the step (f) comprises: 
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(f1) converting the output value of the output layer neurons into a value 
in a predetermined range, calculating reliability values, and adding reliability 
values for the output layer neurons of each neural network; 

(f2) selecting a face detected by a predetermined number of high level 
5 neural networks according to the reliability value; 

(f3) giving a grade to the reliability value of each neural network, and for 
the selected face, calculating a first grade order of the entire neural network and 
a second grade order of a predetermined number of high level neural networks; 

(f4) classifying the selected faces into predetermined face groups, by 
10 comparing the first grade order and second grade order with a predetermined 
first threshold grade order and a predetermined second threshold grade order, 
respectively; and 

(f5) outputting a face belonging to a first face group having a first grade 
and a second grade bigger than the first threshold grade order and the second 
15 threshold grade order, respectively, as the recognition result. 

25. The method of claim 24, wherein the step (f1 ) further comprises: 
converting each output value of the output layer neurons of each neural 

network, into a ratio of each output value of the neural network to the sum of the 
20 output values of a neural network. 

26. The method of claim 25, wherein in the step (f1) each output value of 
the output layer neurons of each neural network is converted according to the 
following equation: 

25 

exp(10w a ) 
y " ^exp(lO^) 

where w a denotes the actual output value of each neuron of a neural 
network and j8 denotes the total number of output layer neurons. 

30 27. The method of claim 25, wherein the step (f1 ) further comprises: 
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calculating the reliability value of a neural network according to the 
following equation by using the converted output value: 

COn f = y.o.lOWl - ^max,2) 

5 where y m ax,i denotes the largest converted output value and y m ax,2 

denotes the second largest converted output value. 

28. The method of claim 27, wherein the reliability value of each neural 
network is set as the reliability value of an output layer neuron having the 

10 largest converted output value, and the reliability values of the remaining output 
layer neurons are set to 0. 

29. The method of claim 26, wherein the step (f3) comprises: 
giving a grade to the reliability value of each neural network; and 

15 calculating a first grade order, in which the grades of entire neural 

network for the selected faces are arranged in order from a high level neural 
network to a low level neural network, and a second grade order, in which the 
grades of the predetermined number of neural networks for the selected faces 
are arranged in order from a high level neural network to a low level neural 

20 network. 

30. The method of claim 26, wherein in the step (g5), among a plurality of 
faces belonging to a first face group, a face which has a bigger sum of reliability 
values calculated in the step (g1) is output as the recognition result. 

25 

31 . A face recognition method for recognizing a face by using an artificial 
neural network, comprising: 

(a) generating eigenpaxels representing characteristic patterns of a face 
and selecting a predetermined number of eigenpaxels among the generated 

30 eigenpaxels; 

(b) training the neural network using the selected eigenpaxels; 
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(c) normalizing an input face image into a predetermined form of the 
face image; 

(d) obtaining an eigenfiltered image containing patterns of face 
characteristics corresponding to the eigenfilters by eigenfiltering the normalized 

5 face image with the respective selected eigenpaxels; 

(e) obtaining an image of a size appropriate to a neural network input by 
sub-sampling each of the eigenfiltered images; 

(f) performing face recognition on each pattern of face characteristics by 
outputting the eigenfiltered and sub-sampled image to a neural network 

10 corresponding to each of the selected eigenpaxels; and 

(g) analyzing the face recognition result of each neural network and 
outputting a final face recognition result of the input image. 

32. A computer readable medium having embodied thereon a computer 
15 program for the face recognition method of claim 1 6. 

33. A computer readable medium having embodied thereon a computer 
program for the face recognition method of claim 31 . 

20 34. A computer readable medium having embodied thereon a computer 

program for the face recognition method of claim 24. 
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